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@ Image processing apparatus and method. 

@ The Invention is intended to prevent detertor- 
atlon in image quality of an Image comprising a 
mixture of a natural Image area, a color charac- 
ter image area. etc. In a process of ADCT rmil- 
thvalue color image compression. In the ADCT 
process, input image data is separated In units 
of different image areas based on OCT coefTt- 
cients after OCT. A quantization factor and a 
quantization table dedicated for natural images 
are used for the natural image area. For the 
color character image area, any suitable one of 
several quantization factors is selected depend- 
ing on magnitude of an absolute value of the 
DCT coefficient, and a quantlzatton table dedi- 
cated for character is used for quantization. 
With this arrangement, deterioration of the col- 
or character image, particulaily, difference in 
deterioration of characters bet¥veen different 
colors, can be prevented. 
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BACKGROUND OF THE rNVENTION 
Field of the Invention 

5 The present Invention relates to an image processing method and apparatus for compressing image data 

in an adaptive manner to an input image. 

Related Background Art 

10 As one o1 techniques for compressing multi- value images, there has been proposed an ADCT (Adapthfe 

Discrete Cosine Transform) compression method mainly applied to natural images. With ttiis compression 
method, three primary (RGB) signals are converted into three components of Y. U and V. Of these components, 
the Y signal representing luminance is compressed at the same resolution, while the U. V signals representing 
chrominance components are compressed at the lowered resolution after sub sampling. In a step I of the com- 

15 pression. each component is subjected to DCT in units of 8 x 8 pixti blocks for conversk>n into a frequency 
space of 8 X 8 to thereby obtain DCT coefTicients. In a step 2. quantization tables are respectively prepared for 
the luminance component (Y) and the chrominance components (U. V) so that the DCT coefTicients are linearly 
quantized (divided) for each component usir^ quantization values of 6 x 8 which are resulted by multi-plying 
quantization factors by respective elements of the 8 x 8 quantization table, thereby obtaining quantization coef- 

20 ficients. In a step 3, quantization coefficients are subjected to Huffman encoding. 

However, when an innage comprising a natural image area, a color character image area and a CG Image 
area in a mixed pattern, for example, is compressed by using the prior art compression method as stated above, 
there has accompanied a sever shortcoming that quality of the color character image and the CG image dete- 
riorates. 

26 Also, it has not been conceived to separately perform quantization of the luminance data and the chromi- 
nance data in respective suitable manners. 

SUMMARY OF THE INVENTION 

30 An object of the present invention is to solve the problem as set forth above. 

Another object of the present invention is to provide an image encoding apparatus which performs encoding 
in accordance with an original image. 

To achieve the above object, according to the present invention, there is provided an innage processing 
apparatus comprising input means for inputting luminance data and chrominance data representing an original; 
3S disaiminating means for discriminating an image characteristic of the original and outputting a discrimination 
signal: first quantizing means for quantizing the luminance data; second quantizing means for quantizing the 
chrominance data; and control means for controlling parameters for said first and second quantizing means In 
accordance with the disaimination signal of said discriminating means. 

Still another object of the present invention is to provide an image encoding apparatus which is highly ef- 
40 fjcient and highly excellent in quality. 

To achieve the above object, according to the present invention, there is provided an innage processing 
apparatus comprising generating means for generating luminance data and chrominance data; first quantizing 
means for quantizing the luminance data: second quantizing means for quantizing the chrominance data; con- 
trol means for generating a control signal for said first and second quantizing means; and encoding means for 
45 encoding the contrd signal and outputting an encoded control signal. 

StII another object of the present invention is to provide an image encoding apparatus which la simple. 
To achieve the ebove object, according to the present invention, there is provided an image processing 
apparatus comprising generating means for generating luminance data and chrominance data; discriminating 
means for discriminating an image characteristic of an image represented by the luminance data and the chro- 
50 minance data; first quantizing means for quantizing the luminance data; second quantizing means for quantizing 
the chrominance data; and control nwans for generating a convnon controlling signal for said first and second 
quantizing means in accordance with the discrimination result of said discrtminating means. 

StOI another object of the present invention is to provide an image encoding apparatus which is suitable 
to process the luminance data and the chrominance data in parallel. 
55 To achieve the above object, according to the present invention, there is provided an Image processing 
apparatus comprising generating means for generating luminance data and chrominance data: first discrimin- 
ating means for discriminating a characteristic of the luminance data and outputting a first discrimination signal; 
second discriminating means for discriminating a characteristic of the chrominance data and outputting a sec- 
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ond discrimination signal; first quantizing means for Quanti2inc the luminance data; second quantizing means 
for quantizing the chrominance data; and control means iot controlling independently said first and second 
quantizing means in accordance with the firet and second discrimination signals respectively. 

Other objects and forms of the present invention will be apparent from the following desaiption In conjunc- 
tion with the drawings and the attached claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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Fig. I is a block diagram of an embodiment of the present invention; 
10 Fig. 2 is a block diagram for calculating an image area separation parameter and quantization factors from 

pre-scan data; 

Fig. 3 is a block diagram of another embodiment of the present invention; and 
Fig. 4 is a block diagram of a still another embodiment of the present invention. 

15 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

In the following embodiments of the present invention, even when an image comprises a mixture of a natural 
image area, a color character image area and a CG image area, these areas are separated from one anottier 
and encoded in respective adaptive manners to prevent deterioration of the color character image, especially 
eliminate differences in deterioration between different colors, for improving quality of the natural image, the 
color character image and the CG image. 

More specifically, input image data is separated in units of image areas sudi as a natural image area and 
a color character image area. A quantization factor and a quantization table dedicated for natural image are 
assigned to the natural image area. For the color character image area, any suitable one of several quantization 
factors can be selected depending on magnitude of an absolute value of the DCT coefficient, end a quantization 
table dedicated for character can be selected. This arrangement makes it possible to prevent deterioration of 
color characters In an image comprising a natural image area, a color character area, etc. in a mixed pattern, 
particularly, deterioration in image quality such as differences in deterioration of characters betv^reen different 
colors. The quantization factors and the image area separation parameter are determined by» for example, pre- 
scanning an image, making a frequency analysis, and calculating values suitable for each image to be proc- 
essed. 

Fig. I shows a first embodiment of the present invention. 

Image data of RGB inputted from an image scanner comprising CCDs or a host computer is converted in 
a color conversion unit I with the following linear matrb( conversion formula: 
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into image data of YUV. Y represents an luminance component and U, V represent chrominance components. 
Considering the fact that human eyes ere more sensitive to the luminance component (Y) than to the chromi- 
nance components (U, V). the components U, V are sub-sampled in a sub sampling unit 2 for conversion into 
data with ratio ofY:U:Vs4:l:lor4:2:2. Then, the components Y. U. V are each subjected in a DCT unit 
3 to frequency conversion in units of 8 x 8 pixel blocks. Thus- converted coefficients are called DCT coefficients. 

An image area separatton unit 6 judges whether each 8x8 pixel block belongs to a natural image block 
or a character image block depending on frequency characteristics of three different DCT coefficients for Y, U, 
V. If it is judged as a natural image block, then a mode 0 is selected by a mode changeover switch 7 using a 
2-bit select signal. If It is judged as a character image block, then to which one of modes I, 2 and 3 the block 
belongs is judged depending on the magnitude of an absolute value of the DCT coefficients end the Judged 
mode is selected in a like manner. In the mode 0, a quantization factor 8 for natural image and a quantization 
table 12 for natural image are used. In the modes 1, 2 and 3, a quantization factor (large) 9 for character, a quan- 
tizaUon factor (medium) 10 for character and a quantization factor (small) II for character are used, respectively, 
along with a quantization table 13 for character. 

More specrically, by way of example, the image area separation unit determines the sum S of absolute 
values of AC components of the spatial frequency conversion coefficients, except DC components, within the 
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block for each of the components Y. U, V, and compares the magnitude of the sum S with threshold values A, 
B. C (where A < 6 < C). It then sets the mode 0 If S < A. the mode I if A £ S < B. the mode 2 if B S S < C. and 
the mode 3 if C S S. 

In a quantization unit 4, the components Y, U, Vare each quantized per 8 x 8 pixel block by using thequan- 
5 tization factor and the quantization table which correspond to the mode selected by the mode changeover 
switch 7. At this time, the 2-bjt select signal indicating the mode used is encoded in an encode unit 14 into com- 
pressed mode data, followed by transmission to the decode side. The mode data is encoded by. for example, 
entropy encoding such as MH, MR or MMR. As a resuU, the quantization factor and the quantization table suit- 
able for each of the natural image area and the character image area can be set For the character image area, 
10 in particular, any suitable one of three different quantization factors can be selected depending on the magni- 
tude of an absolute value of the DCT coefTicients; Le.. the larger quantization factor is used for the block having 
the larger absolute value of the DCT coefficients and the smaller quantization factor is used for the block having 
the smaller absolute value of the DCT coefficients. By so setting, differences in deterioration of characters be- 
tween different colors can be prevented. 
f5 In a Huffman encode unit 5, the quantization coefficients quantized by the quantization unit 4 are subjected 
to Huffman encoding. 

Additionally, the quantization factor 8 for natural image, the quantization factor (large) 9 for character, the 
quantization factor (medium) 10 for character, the quantization factor (small) II fc»r character, the quantization 
table 12 for natural image, and the quantization table 13 for character are transmitted to the decode side or stored 
20 beforehand in a RAM, ROM, etc. in the decode side. 

The compressed data may be expanded in an exactly reversed flow to the above one of signals by omitting* 
the image area separation unit 6. However, the Huffman encode unit 5, the quantization unit 4, the DCT unit 
3 and the encode unit 14 are replaced with a Huffman decode unit, a reverse quantizatk>n unit, a reverse DCT 
unit and a decode unit, respectively. The sub sampling unit 2 is required to convert the components in such a 
25 manner that with the sub sampling ratio being of 4 ; 1 : 1, for example, Yl, Y2, Y3, Y4, Ul, VI,... become Yl, Y2. 

Y3. Y4, UI, U). UI. Ul, VI, VI. VI, VI or that with the sub sampling ratio being of 4 : 2 ; 2, for example, Yl. Y2. 

UI. VI,... become Yl, Y2, Ul, Ul. VI, VI,... The color conversion unit I is only required to perfonm reverse conversion 
of the above formula (1.0). The quantization factor 8 for natural image, the quantization factor (large) 9 for char> 
acter, the quantization factor (medium) 10 for character, the quantization factor (small) It for character, the quan- 
go tization table 12 for natural image, and the quantization table 13 for character can be used by being transmitted 
from the compressk>n side. The reverse quantization is performed in the mode selected by the mode change- 
over switch 7 in response to the select signal obtained by decoding the mode data in the decode unH 

As explained above, by separating an image into different types of image areas and selecting the quanti- 
zation factor and the quantization table adaptively for each image area, the present invention is effective to 
35 prevent deteri(M«tion of a color character image and a CG image, particularly, differences in deterioration of 
color characters between different colors. 

While only two kinds of quantization factors for natural image and character are referred in the above em- 
bodiment, another quantization factor and quantization table for CG image may be added. Also, while only three 
kinds of quantization factors for character, i.e.. large, medium and small, are employed in the above, the number 
40 of quantization factors for character may be four, five or more. 

Further, although the select signal is encoded in the encode unit 14, it may be directly transmitted as the 
mode data to the expansion side without being encoded. 

In the above embodiment, the quantization factors, the quantization tables and the image area separation 
unit Bare prepared as having default values. However, since their optimum parameters are different per image, 
45 optimum values may be calculated by employing a system shown in a block diagram of Fig. 2 for use In the 
above apparatus. Fig. 2 will be explained below. Image data obtained by pre-scan is subjected to frequency 
conversion through the same color conversion unit I, sub sampling unit 2 and DCT unit 3 as those In Fig. I. The 
resultant DCT coefficients are analyzed by a frequency characteristic analysis unit 15. and the analyzed results 
are inputted to both an image area separation parameter calculation unit 16 and a quantization factor calculation 
so unit 17 where an image area separation parameter, a quantization factor for natural image, and quantization 
factors (large, medium, small) for character are calculated. Here, the term 'image area separation parameter" 
means a parameter necessary for separation into image areas. The encoded data are stored in a memory and 
then transmitted via a public line or decoded for display on a monitor to obtain a hard copy by a laser printer 
or a bubble jet printer (using a head disclosed in U.S. Patent No. 4,723,129). 
55 Fig. 3 shows a modification of the above embodiment. Components having similar functions as those in 
Fig. I are denoted by the same reference numerals and wQl not be described here. 

in Fig. 3. the image area separation unit 6 selects any suitat)le one of modes 0 to 4 in accordance with 
only the Y (luminance) data Y. Quantization factors for the U. V data are selected in match with the mode signal 
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for the Y date of the same block. This is based on the fact that image features are likely to be extracted from 

the luminance component, and enables simplification of the circuit configuration. 

In another embodiment of fig. 4, the OCT unit 3. the quantization unit 4, the Huffman encode unit 5 and a 
quantization table control unit 21 are provided for each of Y, U, V independently so as to permit parallel proc* 
essing of those component signals. The quantization control unit 21 comprises the image area separation unit 
6, the mode changeover switch 7, the quantization factor generators 8 to II. the quantization tables 12, 13, and 
the encode unit 14 shov/n in Fig. I 

Encoded data Yl, Y2. Ul. U2. VI, V2 resulted by encoding the components Y. U, V in parallel are stored in 
a transmissfon unit 20 and then transmitted therefrom per block in the order of Yl, Y2. Ul, U2, VI, V2, for example. 
The order of transmission may be the frame sequential order of Y, U, V. 

According to the present invention, as described above, it is possible to prevent deterioration of an image 
in the process of compressing the image. 

It should be understood that the present invention is not limited to the embodiments as set forth above and 
may be variously changed and modiHed within the scope of the invention defined in the attached claims. 

Claims 

1. An image processing apparatus comprising: 

input means for inputting luminance data and chrominance data representing an original: 
discriminating means for discriminating an image characteristic of the original and outputting a dis- 
crimination signal; 

first quantizing means for quantizing the luminance data; 
second quantizing means for quantizing the chrominance data; 

control means for controlling parameters for said first and second quantizing means in accordance 
with the discrimination signal of said discriminating means. 

2. An image processing apparatus according to claim 1, wherein said discrinUnating means disaiminates 
whether said image characteristic is a line image or not. 

3. An image processing apparatus according to daim 1, wherein said first and second quantizing means 
quantize the data for each predetermined block. 

4. An image processing apparatus according to claim 1, further comprising encoding means for encoding 
parameters controlled by said control means. 

5. An image processing method comprising steps of: 

input step of inputting luminance data and chrominance data representing an original; 
discriminating step of discriminating an image characteristic of the original and outputting a discrim- 
ination signal; 

first quantizing step of quantizing the luminance data; 
second quantizing step of quantizing the chrominance data; 

control step of controlling parameters for said first and second quantizing means in accordance with 
the discrimination signal of said discriminating step. 

6. An image processing apparatus comprising: 

generating means for generating luminance data and chrominance data; 

first quantizing means for quantizing ttie luminance data; 

second quantizing means for quantizing the chrominance data; 

control means for generating a control signal for said first and second quantizing means; 

encoding means for encoding the control signal and outputting an encoded control signal. 

7. An image processing apparatus according to claim 6, further comprising disaiminating means for discrim- 
inating a line image portion of an image represented by the luminance data and the chrominance data, 
wherein said control means performs controlling in accordance vnth the discrimination result of said dis- 
criminating means. 

8. An image processing apparatus according to claim 6, wherein said encoding means perfomns entropy en- 
coding. 
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9. An image processInQ apparatus according lo claim 6, wherein said first end second quantizing meant 
quantize the data for each predetermined block. 

10. An image processing method comprising steps of: 

generating step of generating luminance data and chrominance data; 

first quantizing step of quantizing the luminance data; 

second quantizing step of quantizing the chrominance data; 

control step of generating a control signal for said first and second quantizing steps: 

encoding step of encoding the control signal and outputting an encoded control signal. 

11. An image processing apparatus comprising: 

generating means for generating luminance data and chrominance data; 

discriminating means for discriminating an image characteristic of an image represented by the lu- 
minance data and the chrominance data; 

first quantizing means for quantizing the luminance data; 
second quantizing means for quantizing the chrominance data; 

control means for generating a common controlling signal for said first and second quantizing 
means In accordance with the discrimination result of said discriminating means. 

12. An image processing apparatus according lo claim 11. wherein said first and second quantizing means 
quantize the data for each predetermined block. 

13. An image processing apparatus according to claim 11. further comprising discriminating means for dis- 
criminating a line image portion of an image represented by the luminance data and the chrominance data, 
wherein said control means performs controlling in accordance with the discrimination result of said dis- 
criminating means. 

14. An image processing method comprising steps of; 

generating step of generating luminance data and chrominance data; 

discriminating step of discriminating an Image characteristic of an image represented by the lumi- 
nance data and the chrominance data; 

first quantizing step of quantizing the luminance data; 
second quantizing step of quantizing the chrominance data; 

control step of generating a common controlling signal for said first and second quantizing steps 
in accordance with the discrimination result of said discriminating step. 

15. An image processing apparatus comprising: 

generating means for generating luminance data and chrominance data; 
first discriminating means for discriminating a characteristic of the luminance data and outputting 
a first discrimination signal; 

second discriminating means for discriminating a characteristic of the chrominance data and out- 
putting a second discrimination signal; 

first quantizing means for quantizing the luminance data; 
second quantizing means for quantizing the chrominance data; 

control means for controlling independently said first and second quantizing means in accordance 
with the first and second discrimination signals respectively. 

16. An Image processing apparatus according to claim 15. wherein said first and second quantizing means 
quantize the data for each predetenmined block. 

17. An Image processing method comprising steps of: 

generating step of generating luminance data and chrominance data; 

first discriminating step of discriminating a characteristic of the luminance data and outputting a first 
discrimination signal; 

second discriminating step of discriminating a characteristic of the chrominance data and outputting 
a second discrimination signal; 

first quantizing step of quantizing the luminance data; 
second quantizing step of quantizing the chrominance data; 

control step of controlling independently said first and second quantizing steps in accordance with 
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the first and second discrimination signals respectively. 

18. A method or apparatus for compressing video data characterised by; 

determinino the nature of said video data and 

adjusting compression parameters in response to said determination. 

19. A method or apparatus according to claim 18, wherein the nature of the video data is determined to dis> 
tinouish natural image data from synthesised image data. 
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